Minimization of Error Functionals over Variable-Basis Functions
نویسندگان
چکیده
Generalized Tikhonov well-posedness is investigated for the problem of minimization of error functionals over admissible sets formed by variable-basis functions, i.e., linear combinations of a fixed number of elements chosen from a given basis without a prespecified ordering. For variablebasis functions of increasing complexity, rates of decrease of infima of error functionals are estimated. Upper bounds are derived on such rates which do not exhibit the curse of dimensionality with respect to the number of variables of admissible functions. Consequences are considered for Boolean functions and decision trees.
منابع مشابه
On Optimization 14 : 732 - - 742 , 2004 Minimization of Error Functionals over Variable - Basis Functions
There is investigated generalized Tychonov well-posedness of the problem of minimization of error functionals over admissible sets formed by variable-basis functions, which include neural networks. For admissible sets formed by variable-basis functions of increasing complexity, rates of decrease of infima of error functionals are estimated. There are derived upper bounds on such rates that do n...
متن کاملRates of Minimization of Error Functionals over Boolean Variable-Basis Functions
Approximate solution of optimization tasks that can be formalized as minimization of error functionals over admissible sets computable by variable-basis functions (i.e., linear combinations of n-tuples of functions from a given basis) is investigated. Estimates of rates of decrease of infima of such functionals over sets formed by linear combinations of increasing number n of elements of the ba...
متن کاملNative Hilbert Spaces for Radial Basis Functions I
This contribution gives a partial survey over the native spaces associated to (not necessarily radial) basis functions. Starting from reproducing kernel Hilbert spaces and invariance properties, the general construction of native spaces is carried out for both the unconditionally and the conditionally positive definite case. The definitions of the latter are based on finitely supported function...
متن کاملMinimization of Error Functionals over Perceptron Networks
Supervised learning of perceptron networks is investigated as an optimization problem. It is shown that both the theoretical and the empirical error functionals achieve minima over sets of functions computable by networks with a given number n of perceptrons. Upper bounds on rates of convergence of these minima with n increasing are derived. The bounds depend on a certain regularity of training...
متن کاملAn Additive Schwarz Method for the Constrained Minimization of Functionals in Reflexive Banach Spaces
In this paper, we show that the additive Schwarz method proposed in [3] to solve one-obstacle problems converges in a much more general framework. We prove that this method can be applied to the minimization of functionals over a general enough convex set in a reflexive Banach space. In the Sobolev spaces, the proposed method is an additive Schwarz method for the solution of the variational ine...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- SIAM Journal on Optimization
دوره 14 شماره
صفحات -
تاریخ انتشار 2004